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Abstract 


Why  do  some  programs  fail?  What  are  the  factors  that  lead  to  program  success?  Two  organiza¬ 
tions,  the  Systems  and  Software  Consortium,  Inc.  (SSCI)  and  the  Software  Engineering  Institute 
(SEI),  recently  examined  the  reasons,  and  concluded  that  while  many  are  technical  reasons,  the 
greatest  influence  is  people  and  the  things  they  do  individually  and  in  teams  that  lead  to  program 
success  or  failure. 
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Insights  on  Program  Success 


Why  do  some  programs  fail?  What  are  the  factors  that  lead  to  program  success?  Two  organiza¬ 
tions,  the  Systems  and  Software  Consortium,  Inc.  (SSCI)  and  the  Software  Engineering  Institute 
(SEI),  recently  examined  the  reasons,  and  concluded  that  while  many  are  technical  reasons,  the 
greatest  influence  is  people  and  the  things  they  do  individually  and  in  teams  that  lead  to  program 
success  or  failure.  Whether  they  know  when  and  how  to  make  key  decisions;  whether  they  can¬ 
didly  and  openly  share  information  with  one  another;  whether  teams  have  the  necessary  expe¬ 
rience  and  coaching;  and  whether  they  understand  why  the  program  exists  and  what  it  is  meant  to 
accomplish.  Overriding  all  these  considerations  are  two  key  elements: 

1 .  Effective  leadership  and  objective  governance  for  the  program 

2.  Willingness  and  ability  of  program  personnel  to  think  through  problems  and  tailor  the  pre¬ 
scribed  process  to  the  needs  of  the  program 

SSCI  and  the  SEI  each  have  a  unique  perspective.  The  SSCI  staff  has  front-line  access  to  its 
members’  programs  and  operations,  and  has  observed  the  common  elements  that  make  programs 
successful.  The  SEI  staff  has  knowledge  and  expertise  in  engineering  processes  and  systems  de¬ 
velopment,  and  access  primarily  to  “problem”  programs  when  called  upon  by  government  agen¬ 
cies.  While  both  these  organizations  have  a  strong  legacy  of  emphasizing  engineering  processes, 
they  increasingly  see  the  need  to  complement  mature  processes  with  equally  mature  organizations 
and  teams. 

Most  notably,  the  SEI  and  SSCI  found  that  successful  programs  are  a  combination  of  effective 
leadership,  timely  decision  making,  strong  teaming  and  teamwork,  and  good  processes  supported 
by  strong  underlying  practices.  In  contrast,  less  successful  programs  exhibit  a  state  of  confusion 
at  best  and  a  state  of  denial  at  worst  among  individuals,  program  teams,  and  the  organization  of 
which  they  are  a  part.  In  lieu  of  confusion  and  denial,  the  common  characteristic  of  successful 
program  is  not  opting  for  the  easy  path.  Both  SSCI  and  the  SEI  have  observed  this  tendency  in 
many  facets  of  program  work. 

Erom  a  process  perspective  we  have  observed  that  successful  program  teams  don’t: 

•  confuse  process  compliance  with  making  good  decisions 

•  confuse  process  compliance  with  program  performance 

•  confuse  good  processes  with  good  behaviors 

•  confuse  current  processes  with  required  processes 

•  confuse  following  processes  with  thinking  critically 

•  confuse  process  maturity  with  team  and  organizational  maturity 

•  confuse  bureaucracy  with  effective  processes 

Erom  the  perspective  of  relationships  and  communication,  successful  program  teams  don’t: 

•  confuse  program  management  with  customer/supplier  relationship  management 

•  confuse  formal  reviews  with  honest  dialogue 
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•  confuse  teams  with  teamwork 

•  confuse  managing  with  coaching 

•  confuse  management  with  leadership 

Additionally,  from  the  technical  perspective,  successful  program  teams  don’t: 

•  confuse  systems  design  with  systems  thinking 

•  confuse  the  product  development  life  cycle  with  the  program  life  cycle 

Process  frameworks  are  sometimes  criticized  for  not  contributing  to  program  success.  We  believe 
this  is  a  red  herring.  What’s  really  required  for  program  success  goes  well  beyond  process  frame¬ 
works  to  include  a  variety  of  “soft”  issues,  which  leaders  and  teams  frequently  sweep  into  the 
“hard-to-do”  pile. 

The  External  Environment  and  Relationship  to  Processes 

Today’s  environment — the  rapid  pace,  the  ever-increasing  demand  for  features  and  functions,  and 
a  changing  workforce —  creates  new  demands  on  programs.  Program  managers  predominantly 
focus  on  three  basic  factors:  schedule,  performance,  and  cost.  This  is  true  whether  the  program 
resides  at  a  commercial  company  or  the  federal  government.  While  some  external  environmental 
forces  are  largely  beyond  what  process  frameworks  traditionally  have  addressed,  process  im¬ 
provement  remains  one  of  the  best  ways  to  manage  and  control  the  negative  impact  of  schedule, 
cost,  and  requirements  pressure. 

We  find  that  pressure  to  show  progress  against  the  schedule  often  trumps  the  other  factors  and 
creates  an  incentive  to  delay  important  decisions  until  later  in  the  development  cycle,  implement¬ 
ing  the  easy  things  first  to  show  a  quick  “win,”  often  to  the  detriment  of  long-term  program  suc¬ 
cess.  Successful  program  teams  are  willing  to  ask  the  tough  questions,  do  the  hard  things  and 
make  the  difficult  decisions  up  front — even  if  it  means  failing  hard  and  fast —  rather  than  waiting 
until  the  end,  when  program  failure  is  almost  guaranteed  and  the  cost  overrun  has  been  substan¬ 
tial. 

Meanwhile,  the  demand  for  higher  performance  with  more  features  and  functions  has  led  to  vastly 
more  complex  systems  than  we  saw  even  10  years  ago.  This  rising  technical  complexity  results  in 
lower  risk  tolerance — in  fact,  people  often  fear  that  their  jobs  depend  on  total  elimination  of  risk. 
This  leads  to  paralysis  in  making  decisions,  as  truly  risk-free  engineering  programs  are  impossible 
to  achieve. 

The  increasing  specialization  of  our  society  contributes  to  the  problem.  Students  today  may  grad¬ 
uate  with  in-depth  knowledge  in  programming  languages,  but  with  little  knowledge  in  design, 
testing,  and  analysis,  leaving  them  ill -equipped  to  make  critical  decisions,  or  for  far-reaching  dis¬ 
cussions  about  how  a  program  should  proceed.  Program  success  relies  on  coaching  and  mentoring 
less  experienced  engineers  so  that  they  understand  the  impacts  of  their  decisions  within  a  greater 
system  context. 

The  environment  will  only  become  more  challenging.  Times  have  not  only  changed;  the  rate  of 
change  is  accelerating,  while  at  the  same  time  organizations — government,  contractors,  program 
teams — have  not  generally  demonstrated  an  ability  to  keep  pace.  The  criticism  of  process  frame- 
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works  and  a  lack  of  relationship  to  program  success  stems  in  part  from  an  inability  to  manage  and 
adapt  to  the  increasing  rate  of  change  and  in  part  from  unwarranted  expectations  on  the  part  of 
organizations  that  process  maturity  alone  will  provide  sufficient  operational  performance  regard¬ 
less  of  the  program  environment. 

Integrating  Good  Processes  and  Good  Decision  Making 

Effective  program  teams  drive  success  through  the  integration  of  good  processes  and  good  deci¬ 
sion  making.  Successful  programs  don’t  confuse  one  with  the  other  or  try  to  do  one  without  the 
other.  Rather,  successful  program  teams  have  the  discipline  to  think  through  hard  problems  using 
processes,  as  appropriate,  to  reach  the  best  decisions  at  the  time  those  decisions  need  to  be  made. 
An  organization’s  processes  can  provide  a  framework  and  basis  for  decision  making,  but  critical 
thinking  combined  with  a  culture  that  celebrates  calculated  risk  acceptance  is  the  secret  sauce  for 
making  effective  decisions. 

The  timeliness  and  quality  of  decisions  at  major  decision  points  are  effective  indicators  of  pro¬ 
gram  success.  Successful  programs  make  decisions  in  a  timely,  well-thought-out  manner  and 
avoid  delaying  hard  decisions.  Many  decisions  must  be  made  as  a  program  is  developed:  whether 
the  product  is  built,  how  to  proceed,  who  are  the  right  people  to  put  on  the  team,  and  what  are  the 
ways  to  ensure  effective  implementation?  How  often  are  decisions  or  requirements  deferred  to  a 
later  date  or  release?  Are  the  action  items  completed  within  the  time  assigned  or  are  they  left  open 
for  longer  periods  of  time?  What  is  the  staffing  level,  by  roles  or  functions  over  time  within  the 
program?  What  about  the  key  positions  and  the  staffing  levels? 

Effective  communication  mechanisms  and  a  culture  that  encourages  open,  honest  dialog  enable 
the  information  sharing  needed  for  effective  decision  making.  In  successful  programs,  teams  ex¬ 
hibit  a  collaborative  culture  that  fosters  an  attitude  of  collective  responsibility.  They  work  to  sup¬ 
port  each  other  and  the  program  as  a  whole.  Decisions  are  based  on  a  more  complete  understand¬ 
ing  of  the  issues  and  possible  implications  and  are  “owned”  by  the  team.  The  team’s  sense  of 
responsibility  and  commitment  provide  the  “can-do”  attitude  that  drives  the  program  towards  suc¬ 
cess. 

But  making  timely  decisions  is  only  part  of  program  success.  Good  decisions  often  mean  making 
hard  choices  that  are  uncomfortable  for  the  decision  maker.  When  decisions  are  made,  successful 
programs  communicate  the  decisions  and  potential  impacts  not  only  to  the  development  team,  but 
also  to  all  of  the  major  stakeholders,  especially  the  customer.  Effectively  communicating  difficult 
decisions  can  help  to  build  trust  within  the  organization  and  between  the  customer  and  contractor. 
A  mistake  is  not  necessarily  a  bad  thing  if  an  organization  learns  from  it  and  willingly  shares  the 
information. 

Careful  consideration  of  the  following  questions  will  increase  the  likelihood  of  program  success: 

•  What  are  the  most  important  decisions  that  will  affect  the  overall  success  of  the  program  for 
all  major  stakeholders  including  the  customer  and  the  contractor? 

•  When  do  those  decisions  have  to  be  made? 

•  Have  working  relationships  been  established  — internally  and  externally — to  support  and  im¬ 
plement  those  decisions? 
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•  To  what  extent  do  current  processes  increase  the  confidence  in  the  quality  and  timeliness  of 
decisions  that  have  to  he  made? 

•  Do  all  parties  have  the  insight  and  perspective  to  interpret  and  assess  the  information  availa¬ 
ble  in  making  key  decisions? 

Both  SSCI  and  the  SEI  were  created  to  increase  the  ability  of  government  and  industry  to  success¬ 
fully  execute  large,  complex,  software-intensive  programs.  And  while  both  organizations  have 
made  major  commitments  to  developing  best  practices  and  effective  processes,  it  is  increasingly 
apparent  that  effective  processes  are  necessary  but  not  sufficient  for  program  success.  It’s  when 
those  processes  are  integrated  with  effective  leadership,  strong  teaming,  and  timely  decision  mak¬ 
ing  that  programs  succeed. 
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